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Abstract —The self-organizing behavior of swarms of inter¬ 
acting particles or agents is a topic of intense research in fields 
extending from biology to physics and robotics. In this paper, we 
carry out a systematic study of how the stable spatio-temporal 
patterns of a swarm depend on the number of agents, in the 
presence of time-delayed interaction and agent heterogeneity. 
We show how a coherent pattern is modified as the number 
of agents varies, including the time required to converge to 
it starting from random initial conditions. We discuss the 
implications of our results for curve-tracking using autonomous 
robotic systems. 

1. Introduction 

The dynamics of interacting multi-agent or swarming 
systems in many biological, physical and engineering fields 
is undergoing very active research. Remarkably, these sys¬ 
tems are able to self-organize into highly structured spatio- 
temporal patterns and demonstrate complex collective behav¬ 
iors, with very limited information passed between individ¬ 
ual agents. Examples in biology include bacterial colonies, 
schooling fish, fiocking birds, swarming locusts, ants, and 
even pedestrians [1]-[11]. 

One of the practical goals in swarming research in robotics 
is to bring the advantages of aggregation in biological 
systems, such as scalability and robustness, into engineered 
systems. To achieve scalability, the individual agents that 
make up the aggregate should be simple and inexpensive, 
and easily added to the overall swarm. For robustness, it 
should be possible to have agents fail and be removed 
from the swarm, without significantly affecting the collective 
dynamics. In fact, aggregates of locally interacting agents 
have been proposed as a means to create scalable sensor 
arrays for surveillance and exploration [12]-[18]; and for 
the formation of reconfigurable modal systems, in which a 
group of simple agents can be used to accomplish a task that 
would be impossible for any agent individually [18]-[20]. 

A thorough understanding of the dynamical properties of 
the swarm is necessary for algorithm design and implemen¬ 
tation. Many different approaches are possible in order to 
elucidate this: a number of works treat the swarm at a the 
level of individual agents [5], [8], [9], [21]; others have 
attacked the problem via continuum models [4], [7], [22]. A 
number of studies show that even with simple interaction pro¬ 
tocols, swarms of agents are able to converge to organized, 
coherent behaviors. Interestingly, environmental noise and 
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processing time delays affecting the agent dynamics can lead 
to the formation of new steady-state motions, bistability and 
hysterisis, or phase transitions between between co-existing 
steady states [23]-[25]. Noise is used to model the effects 
of external, unforeseen disturbances as well as unmodeled 
inter-agent interactions, including uncertain coupling and/or 
communication. On the other hand, time delays are essential 
for modeling finite communication and processing speeds 
in many interacting biological systems, including population 
dynamics, blood cell production, and genetic networks [26]- 
[28], or in mathematical models of robot networks with 
explicit communication and processing delays [29]. 

Biology has shown us that swarms exist in stable config¬ 
urations composed of a great many single agents. Motivated 
by this observation, a number of existing works on the 
spatio-temporal patterns of swarm dynamics present results 
that are valid in the so-called “thermodynamic limit,” where 
the number of agents is assumed to be very large [4], 
[21]-[25], [30], [31]. This limiting situation is attractive on 
several grounds and is particularly amenable to mean-field 
approximations that allow one to make analytic predictions 
on the collective behavior of the swarm. However, in most 
real-world situations, the size of the swarm is limited by 
the cost of individual agents, bandwidth requirements, agent 
malfunction, etc. It is therefore important to verify how well 
the analytical predictions for collective motion made in the 
thermodynamic limit hold as swarm size is reduced. 

In addition, most existing work assumes that the mem¬ 
bers of the swarm are identical. However, many practical 
applications involve swarms that are composed of agents 
with differing dynamical properties from the onset, or that 
become different over time due to malfunction or aging. 
Swarm heterogeneities lead to interesting new collective 
dynamics such as spontaneous segregation of the various 
populations within the swarm; it also has the potential to 
erode swarm cohesion. In biology, for example, it has been 
shown that sorting behavior of different cell types during 
the development of an organism can be achieved simply 
by introducing heterogeneity in inter-cell adhesion proper¬ 
ties [32], [33]. It has also been shown that increasing the 
neighbor-to-neighbor attraction between cells of a single type 
leads to segregation of types in aggregates of self-propelled 
cells [34]. In robotic systems, heterogeneity may arise over 
time when, for example, battery depletion, or other losses 
of functionality, occur at different rates for different agents 
within the swarm. Allowing for heterogeneity in dynamical 
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behaviors of swarm agents gives greater flexibility in system 
design, and is therefore desirable not only from a theoretical 
but also from a practical point of view. 

In this work we address the issues of coherent-pattern 
scalability and robustness for a delay-coupled swarm with 
heterogeneous agents performing a path-following mission. 
We extend a globally delay-coupled swarm model in [23], 
[24] to swarms with heterogeneous agent dynamics. We 
conduct a careful numerical analysis to examine the scaling 
behavior of the coherent patterns of the swarm as the 
number of agents varies over a wide range. In particular, 
we investigate how long it takes the swarm in an arbitrary 
configuration to acquire a particular coherent pattern. This 
state exploits the segregation of heterogeneous agents in 
the swarm to create a state that separates agents according 
to their natural motion. The approach is novel in that it 
promote robustness by eliminating weaker agents that might 
negatively affect the performance of the swarm and serve as 
a metric for the health of the entire swarm. 


II. Problem Statement 

We investigate the pattern-transition capabilities of a two- 
dimensional swarm of autonomous agents as it carries out a 
mission. For definitive purposes, we take this mission to be 
the tracking of a virtual “leader agent” that moves along an 
arbitrary curve C. We assume that each agent can measure the 
distance and relative heading to all other agents in the swarm 
and of the virtual leader. These measurements are relatively 
easy to obtain using inexpensive sensors, and do not require 
the agents to agree on a common reference frame. 

At some point during the curve-tracking, the swarm is 
made to transition to a stationary, Ting’ coherent pattern 
that may serve as a diagnostic state to identify the agents 
with degraded performance. Of particular interest is how the 
spatio-temporal scales of this diagnostic state depend on the 
number of agents present as well as the time to acquire said 
pattern. 

We now introduce the dynamical model for the swarming 
agents and the virtual leader. Let r^(t) G denote the 
position of agent i in the swarm, i G A^}. Each 

agent has self-propulsion with a preferred speed that is scaled 
to 1, and additionally is attracted to the other agents in 
the swarm and to the leader. The coupling coefficient that 
quantifies the attraction between agents in the swarm is a, 
while the coupling coefficient between each swarm agent 
and the leader is aL . We consider that the attraction between 
agents occurs in a time-delayed fashion, on account of finite 
communication speeds and processing times; we assume a 
single, fixed time delay denoted by r. The position of the 
virtual leader is given by TL{t). The leader is confined 
to stay on the curve C. Let 5 G M denote the speed of 
the leader along C. The dynamics of the swarm particles 
and leader are described by the following dimensionless 


governing equations: 

N 

Ti = Ki(l- II Ti f) i-i - ^ - rj{t - r)) 

i=i 

+ aLKi{ri{t) - rL{t)) ( 1 ) 

s={l-s)-ao\\rL{t)-'R{t)\\, (2) 

where dots are used to denote differentiation with respect 
to time. The self-propulsion of agent i is modeled by the 
term — || f^. At time t, agent i is attracted to 

the position of agent j at the past time t — r and to the 
current position of the leader. The factor ni G (0,1] scales 
the acceleration of agent i, behaving like an inverse mass. 
One may interpret it as a measure of the battery state of 
agent i or some other source of heterogeneity that impedes 
acceleration. We assume that for a given number of agents 
in the swarm, ki is given by a uniform distribution on 
(0,1]. This simplified model does not include short-range 
repulsion or other collision-avoidance strategies; however, 
earlier studies with homogeneous swarms indicate that the 
collective dynamics of the swarm are not significantly altered 
by the introduction of short-range repulsion terms [23]. 

We will show, using simulation, that the controller de¬ 
scribed above tracks the position of the virtual leader agent 
along the curve. We will further show that, to achieve 
segregation of the swarming agents by ti, it is sufficient to 
set the speed of the leader agent to 0, for appropriate values 
of the parameters a and r. For application of our theoretical 
results in a real-world setting (where number of agents is 
typically limited by space, cost, or communication bandwidth 
requirements), we run extensive numerical simulations to 
examine how collective behavior of the swarm depends on 
the number of its constituent agents N. 

III. Curve Tracking 

The goal of the curve-tracking behavior is to have the 
center of mass of the swarm track the length-parametrized 
curve C. To this end, we introduce the virtual leader agent, 
with position VL{t) G C, and add a proportional control term 
aLKi(ri(t)-rL(t)) in Q to track the position of this agent. 

The acceleration of the virtual leader along C is given by 
and includes a self-propulsion term as well as a feedback 
term that reduces acceleration proportionally to the distance 
from the virtual leader position the the swarm center of mass. 
A series of snapshots of the swarm tracking the virtual leader 
along a circular trajectory are shown in Fig. 

IV. Diagnostic Mode 

The system is switched into diagnostic mode by setting the 
leader speed s = 0. When this happens, the swarm converges 
to a ring state, in which the center of mass is fixed at the 
position of the leader, while particles in the swarm rotate in 
either direction about the center, with radius that depends 
on the coupling constants a and a^, and on the individual 
constant of acceleration Ki. 


3 



1 

/" 

1 

1 

1 

: 

y' ' 


X 

(a) t = 81.8 



( b ) t = 144.8 


15 

1 

10 

1 

5 

1 

y 

Ol o 

'v > 1 

-10 

-15 


-10 0 10 


X 


(c) t = 228.8 


Fig . 1 : Snapshots from simulation of swarm tracking a 
circular trajectory. The position of the virtual leader is shown 
by the red box; the red arrow indicates the direction of the 
leader agent’s motion. The center of mass of the swarm is 
marked by a black x. Agent positions are shown by circles, 
with colors indicating the respective values of Ki. The values 
of Hi in this simulation are uniformly distributed on [0.2,1]. 
The coupling constant a = 0.1, = 0.06, and the delay is 

r = 1. The coupling coefficient of the leader to the swarm 
is ao = 0.06. 


In this section, we conduct a careful theoretical analysis 
of the center of mass dynamics of the swarm in the ther¬ 
modynamic limit (N oo), extending results presented 
for the leaderless, homogeneous swarm case (a^ = 0 and 
/^i = l, in [23]. 


Proceeding as in [23], let R(t) = ^ the 

center of mass of the swarm, and let Sri(t) = r ^( t ) — R ( t ) 
be the position of agent i relative to the center of mass; 
note that = 0. Using the change of variables 


r,(t) = R(i) + (5r,(4(0 can be written 


as 


R + Sri = Hi 1 — R 


- II Sri 11^ - 2(R, (5ri))(R + Sri) 


-^^(R(t) + Sri(t) - R(t - t) - Srj(t - t)) 


- aLKi(R(t) + Sri(t) - R(t) - SrL(t)). 


(3) 


Without loss of generality, we set the stationary leader 
position to 0. Following the approach in [23], we sum 
0 over i, then take the limit as oo and neglect all 

terms in (see [23] for a justification of this simplification). 
The resulting equation for the motion of the center of mass 
of the swarm in the thermodynamic limit is: 


R = K 



R 


R—(a-j-ai,)KR(t)-j-aKR(t—T), (4) 


where ^ ^ the mean acceleration factor. The 

above system has an equilibrium point at R = R = 0, which 
corresponds to the ring state. As a and r increase (for fixed 
values of the parameters hl and R), the system undergoes 
a Hopf bifurcation, giving rise to a new oscillating steady- 
state behavior, whereby the swarm becomes more compact ad 
organizes itself in to a coherent rotating state. To ensure that 
the system converges to the ring state given r and estimated 
R, we choose a and ai, so that the system lies below the first 
Hopf bifurcation curve (see Fig. [^. 

Once the system enters the ring state, the agents with 
low battery power (denoted in our model by low Hi) can 
be picked out from the radius of the circular trajectory they 
follow about the fixed center of mass. To see this, consider 
0. As before, we set ri, = 0, so that in the ring state, 
R = R = 0. Equation ^ then simplifies to: 

Sici = Ki(l- II (5ri Sri 

- ^ - r)) - aLKiSri(t). (5) 

Taking the limit as ^ oo and converting to polar 
coordinates {pi,0i), where pi denotes the distance of agent 
i from the origin and Oi denotes the phase, gives 

Pi = Ki(l - p^of - Pi)Pi + {Oi - (a + aL)Ki)pi (6) 

PiOi = Ki{l - pIoI - pDpA - 2pi0i. ( 7 ) 

In the ring state, pi = Oi = pi = 0; setting these values in 
the above equations gives 

Oi = ±A{a + aL)K.i ( 8 ) 

Pi = l/\0i\ = l/\/{a + aL)ni. ( 9 ) 


Thus, in the ring state, agent i circles the stationary 
leader position with radius inversely proportional to . As a 
result, we can easily identify the agents with limited motion 
capabilities by distinguishing the agents whose radius in the 
ring state exceeds a certain pre-specified threshold. As an 
example. Figure shows the case in which we wish to 
eliminate all agents with Hi < 0.5; the threshold radius is 
then Pth = 1/\/0.5(a + hl) as shown in the figure. 
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a 

(a) ^ = 0.2, aL = 0 (leaderless case) 



a 

(b) R = 0.61, ttL = 0 (leaderless case) 




(c) K. — 0.2, aL = 0.06 


(d) K. — 0.61, gl — 0.06 


Fig. 2: The solid blue lines show r vs a Hopf bifurcation curves for the center-of-mass heterogeneous swarm dynamics, 
for different values of the parameters R and a^. The simulation in Section lOT were run with parameter values marked by 


the red X in Fig. 2d 


V. Finite N Effects 


We now investigate how the spatio-temporal scales of 
the ring state, as well as how the length of time required 
to achieve it varies with the number of agents N. We 
consider the system to be in the ring state once the swarm’s 
mean radius to its center of mass has converged to a small 
neighborhood about the average value. 


Firstly, we set Ki = 1 for all agents and study the 
dependence of swarm collective motions on finite N. Using 
numerical simulations, we have measured the time required 
to converge to the ring state over 100 trials for random 
initial conditions at various population sizes, ranging from 
= 2 to = 150. As expected, for large N, the dynamics 
converge to a ‘thermodynamic limit’ and are qualitatively 
similar in almost all trials. Fig. 4a shows that for large 
population sizes the times to converge are relatively constant, 
but as N decreases the convergence time and the variance 
of these times increases dramatically. For very small N the 
system is far less predictable and will at times converge to 
a periodic motion different from the ring state. 


When agents do converge to the ring state, we can make 
the following theoretical prediction for the radius p of the 
ring in the finite-A^ case, under the assumption that agents 
are uniformly distributed along the ring: 


= a ( 1 — -(1 — cosccr) 


P = 


1 


a smccr 


1 


( 10 ) 


( 11 ) 


uj V Nuj 

where uj is the angular frequency of the agents moving about 
the ring. For N ^ oc these reduce to = a and p = ^, 
which agrees with Eq. (|^ for the ring radius in the large N 
limit, remembering that = 0 and Ki = 1 in the current 
situation. In this case of homogeneous k, Figure shows 
good agreement between the simulated radius and velocity 
and the predictions of these quantities as given above. 

For the uniform k, case, When N is very small (less than 
10), a wealth of behavior emerges that is far less likely for 
large N. For example, when A^ = 5 the most prevalent state 
arranged all five agents equally along a circle in a pentagonal 
pattern, rotating in the same direction. These symmetric 
patterns exhibit extremely rapid convergence times from 
random initial conditions, which explains the surprising rapid 
decrease in convergence times for small N shown in Fig. 
4a Formally identifying these patterns and justifying their 
unique behavior is an area of future work that we plan to 
investigate. 

Next we consider the case of distributed Hi as described 
in Section |n| We repeat the numerical simulations conducted 
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Fig. 3: Snapshot from simulation of swarm in diagnostic 
state. The virtual leader is marked by the red box; the 
center of mass of the swarm is marked by a black x and 
is coincident with the leader position. Agent positions are 
shown by circles, with colors indicating the respective values 
of Ki. All agents with ni > 0.5 are contained inside the green 
circle; agents which lie outside may be eliminated. 


for Ki = 1 io measure the time required to converge to an 
apparent ring state over 100 trials with randomly distributed 
initial conditions and uniformly distributed over [0.2,1] 
in each trial over various values of N. The results of 
these simulations are shown in Figure demonstrating a 
similar relationship of time-to-convergence with N as in the 
uniform k case. The mean radius of the ring converges to 
approximately 1.4, which is consistent with the mean-field 
prediction for a = 1, = 0, and Hi uniformly distributed 

on [0.2,1]. Fig. shows the mean ring radius and velocity 
of agents in the ring state. 

VI. Conclusion 

In this paper we have used curve following as a sample 
application for the use of collectively moving autonomous 
agents. We have shown how the naturally-emerging col¬ 
lective motions of interacting autonomous agents can be 
exploited to segregate agents with different dynamical prop¬ 
erties, even when they follow the same overall behaviors 
as other agents in the swarm (in our case, we separated 
out agents with lower acceleration factors, corresponding to 
depleted battery state or mechanical failure). 

Furthermore, we have analyzed collective motions of 
delay-coupled heterogeneous agents. We tested the limits 
of the commonly-used thermodynamic limit for modeling 
swarm populations by considering the effects of finite swarm 
size on time to converge to a given pattern (in this case, 
the ring state), and by comparing the ring state radius and 
circulating velocity with theoretical predictions based on the 
thermodynamic model. We have verified that the theoretical 
predictions of the thermodynamic limit hold very well for 
large (100 -f agents) and medium (20-\- agents) swarms, but 
break down for smaller numbers of agents. In this few-agent 
limit, the swarm often does not converge to the expected 




Fig. 4: Time for the system to converge to ring state for 
different values of swarm size N. Parameter values are a = 
l,aL=0, r = l and K,i = I for all i (top panel) and Hi 
uniformly distributed on [0.2,1] (bottom panel). 

ring, and we observe the emergence of more exotic collective 
periodic patterns. 

In the current work, we have assumed that the agents 
in the swarm are globally coupled. This is generally not 
feasible in swarms of more than a few agents, on account 
of communication bandwidth requirements. In future work, 
we will relax this assumption to consider less than fully 
connected swarms. We will also consider the effects of inter¬ 
agent repulsion on the collective dynamics. 

Our work represents an important link between theory 
of aggregate systems (generally developed in the thermody¬ 
namic limit) and practical applications of swarming systems 
(which generally contain few agents). 
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